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ABSTRACT 



This research brief uses data collected by the Center for 
Policy Research on the Impact of General ..and Special Education Reform to 
highlight issues surrounding the inclusion and exclusion of students with 
disabilities in state accountability systems. The brief discusses the 
background of standards -based reform, traditional general education 
accountability, and changes to general education accountability systems. 
Strategies for including students with disabilities in general education 
accountability are then reviewed and the role of federal compliance 
monitoring in accountability is outlined. Issues associated with including 
students with disabilities in general education accountability are discussed. 
Recommendations include: (1) special educators and families should be 

involved in discussions about state accountability systems and help shape 
accountability policies; (2) states need to establish policies that provide 
consistent guidelines for assessments; (3) state departments of education 
need to work closely with federal agencies when constructing integrated 
monitoring documents and policies; (4) special educators and families should 
be part of the development of state support strategies for failing schools as 
well as benefit from state rewards when schools perform well; and (5) 
continued efforts should be made to develop compliance monitoring that 
supports program improvement and student achievement. (OR) 
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The Center for Policy Research on the Impact of 
General and Special Education Reform 

In October 1994, the U.S. Department of Education’s Office of Special 
Education Programs (OSEP) established a Center for Policy Research on the 
Impact of General and Special Education Reform (the Center) to study the 
interaction between current general and special education policies and their 
impact on students with disabilities. The Center is a joint endeavor of the 
National Association of State Boards of Education (NASBE), the Institute for 
the Study of Exceptional Children and Youth at the University of Maryland 
(UM), and the Consortium for Policy Research in Education (CPRE) at the 
University of Pennsylvania, and is housed at NASBE. 

Each Center partner is conducting interrelated three-year research stud- 
ies that examine reforms in general and special education policies, their inter- 
actions, and their implications for students with disabilities. Areas being re- 
searched include standards and curriculum, assessment, accountability, teacher 
policy, finance, and governance, as well as state responses to federal programs 
such as Goals 2000 and the School-to-Work Opportunities Act. This issue 
brief uses data collected by the Center during its first year of research (1995) 
to 1 ) describe major trends in general education reform from a standards-based 
perspective across the 1 8 states in our study; 2) provide a preliminary assess- 
ment of the nature and involvement of special education in these reforms at the 
state level; and 3) discuss implications of these reforms for students with dis- 
abilities and related emerging issues. 
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STATE ACCOUNTABILITY SYSTEMS AND 
STUDENTS WITH DISABILITIES 



Preface 

In October 1994, the U.S. Department of 
Education’s Office of Special Education Programs 
(OSEP) established a Center for Policy Research on 
the Impact of General and Special Education Reform 
(the Center) to study the interaction between current 
general and special education policies and their 
impact on students with disabilities. The Center is a 
joint endeavor of the National Association of State 
Boards of Education (NASBE), the Institute for the 
Study of Exceptional Children and Youth at the 
University of Maryland (UM), and the Consortium 
for Policy Research in Education (CPRE) at the 
University of Pennsylvania, and is housed at NASBE. 

Each Center partner is conducting interrelated 
three-year studies that examine reforms in general and 
special education policies, their interactions, and their 
implications for students with disabilities. Areas 
being researched include standards and curriculum, 
assessment, accountability, teacher policy, finance, 
and governance, as well as state responses to federal 
programs such as Goals 2000 and the School-to- 
Work Opportunities Act. This issue brief uses data 
collected by the Center during its first and second 
years of research (1995-96). 

Background 

Over the past several years federal, state, and 
district policy makers have promoted a system of 
standards-based reform in order to simultaneously 
promote more rigorous curricula and goals for 
education as well as enhance the ability of every 
student to reach those goals. Standards-based reform 
emerged in the 1990s as a system of reform designed 
to address policy fragmentation generated by a series 
of conflicting state-initiated, top-down reforms 



(Smith and O’Day, 1991). 

Standards-based reform has three 
primary tenets (Smith and O’Day, 

1991): 

• unifying vision and goals; 

• coherent system of state 
policy guidance; and 

• restructured governance. 

As part of the restructured 
governance system, “state government is to set 
system and student goals for the state, coordinate 
these long-term instructional goals across various 
state policies, and hold schools and school districts 
accountable for meeting these goals.” Changes in 
governance recommended under standards-based 
reform are based on the premise that local districts 
need flexibility to exercise critical judgement and 
mobilize resources necessary to help students achieve 
expected standards. However, with greater flexibility 
comes a commensurate increase in responsibility for 
student outcomes by local districts, schools, and 
teachers. While reformers have called for 
decentralizing authority and providing greater latitude 
in decision-making to district-and building-level 
educators, they also recognize a greater need for a 
state accountability system to ensure student progress. 
While many states have had accountability 
mechanisms in place, standards-based reform is 
encouraging states to look anew at their accoun- 
tability systems, particularly with an eye toward 
associating accountability indicators with student 
outcomes instead of the input elements of schooling. 

Accountability may be defined at two levels — 
system accountability and student accountability. 
System accountability includes measures designed to 
hold school and districts accountable. Traditionally, 
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system accountability has focused on resource inputs 
and processes perceived as necessary for schools to 
adequately serve students. With standards-based 
reform, system accountability reduces its emphasis on 
inputs and processes while it expands to include 
evaluation of student outcomes. Student outcomes 
typically are measured in terms of performance on 
assessments. Hence, three elements for system 
accountability are: inputs, processes, and student 
outcomes. 

Student accountability is focused on measures 
designed to hold individual students accountable for 
their performance, including grading, promotion and 
graduation requirements. Graduation requirements 
may be based on passing a state graduation exam, 
obtaining a particular grade-point average, earning a 
particular number of Carnegie units, or some 
combination of all three. Grade promotion 
requirements may include obtaining a particular 
grade-point. average or score on a state- or district- 
generated assessment. Student-level accountability 
components are often included in the larger state 
accountability system. 

Accountability systems are structured through a 
variety of mechanisms, including district and state 
report cards, accreditation reviews, compliance 
monitoring of state and federal programs, and self- 
study/quality improvement plans. These reviews may 
be based on district- and school-generated indicators, 
or on state or federal indicators. Furthermore, local 
systems may be held accountable for meeting state 
standards, or for meeting district-developed goals. 
Overall, variations in state accountability models 
depend on: 

• Who determines the indicators and standards to 
be used; 

• Types of indicators included; 

• Levels of the system that are held accountable; 

• Consequences applied if a deficiency is found 
and not rectified; and 



• Degree to which all students and programs are 

included in the accountability system. 

Special education has so far played a limited 
role in standards-based reform (Goertz and Friedman, 
1996). The purpose of this issue brief is to provide 
policymakers, practitioners and families information 
which enables them to become active players in 
developing new accountability systems that include 
students with disabilities. We will review the merits 
of including students with disabilities in state 
accountability systems, the ways in which state 
education accountability systems are changing, 
corresponding changes in special education 
accountability, and issues associated with including 
special education and students with disabilities in 
general education accountability. The issue brief will 
conclude with recommendations for families, educa- 
tors, and policymakers at the state and federal levels. 

The Importance of Including Students 
with Disabilities in General Education 
State Accountability Systems 

Why is including special education and students 
with disabilities in accountability systems important? 
First, federal law requires it. Federal legislation 
enacted over the past several years requires that 
students with disabilities be included in different 
aspects of standards-based reform (Goals 2000: The 
Educate America Act, 1 993; Improving America’s 
Schools Act, 1994; IDEA, as amended, 1997). 

Despite these measures, special education has 
played a limited role in creating standards-based 
reform policy (Goertz and Friedman, 1996), and 
students with disabilities are often excluded from the 
general curriculum, state and district assessments, and 
accountability at both the system and student level 
(Elliot and Thurlow, 1997; Roach and Raber, 1997). 

In many schools, no one feels accountable for 
enhancing the outcomes of students with disabilities. 
Many educators and advocates contend that, although 
students with disabilities are increasingly educated in 
the general education classroom (Office of Special 
Education Programs, 1996), general educators do not 
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feel accountable for the performance of students with 
disabilities (Elliott and Thurlow, 1997; Roach and 
Raber, 1997; Schnorr, 1990). This is partially due to 
organizational factors. Students with disabilities often 
do not appear on the rosters of classes in which they 
are mainstreamed, are excluded from state or district 
assessment programs, and are not graded in the same 
manner as other students. This is, in part, a by- 
product of years in which special education has been 
structured and perceived as a separate system from 
the general program (NASBE, 1992). 

Conversely, special educators may not feel 
accountable for the outcomes of students with 
disabilities. The majority of students receiving special 
education spend most of their time in general 
education classrooms. In addition, the only form of 
accountability in special education designed to focus 
on outcomes, the Individual Educational Plan (IEP), is 
primarily reviewed for due process compliance, not 
student outcomes. 

Another reason for including students with 
disabilities in the general accountability program is 
because it functions as a key vehicle for including 
students with disabilities in more challenging curricula 
as defined in new state standards. Accountability is 
the state policy mechanism that links new standards 
to what is taught and tested in schools. New 
accountability systems are increasingly relying on 
assessments as tools for measuring student outcomes. 
Assessments are being developed based on state 
standards. In order to ensure that students perform 
well on assessments, teachers are supposed to teach to 
the standards. Within this framework, including 
students with disabilities in general accountability 
systems provides incentives for including them in the 
higher expectations associated with standards and 
should ultimately improve outcomes for those 
students. 

Finally, if students with disabilities are not 
included in general education accountability systems, 
they will be perceived as existing in a separate system 
outside the mainstream student body. Attempts to 
include students with disabilities as part of the overall 
student population will be confounded by the 



perpetuation of dual accountability systems for 
general and special education. Unifying special and 
general education systems has been a reform theme 
since the early 1990s (NASBE, 1992; NASDSE, 
1994). For some, including students with disabilities 
in the general accountability system is merely an 
extension of the inclusion-movement that has been 
underway for several years. As such, advocates are 
supporting inclusion of students with disabilities in 
all facets of the general school system — including 
the accountability system. 

Traditional General Education 
Accountability 

Traditionally, states have held local education 
agencies accountable for: 

• inputs to the education system; 

• processes used in the education system; and 

• operation of specific programs , generally 

targeted at special populations of students. 

Accountability has been largely based on inputs 
to the system. Examples of input measures include: 
number of books in the library, square footage 
allocation per student in a school, and the number and 
age of textbooks used in the district. This type of 
accountability assumes certain resources and 
conditions must be available to create a safe, 
productive learning environment. It also assumes that 
to the extent those resources are available, student 
learning will occur. 

In addition to accounting for specific inputs, 
many accountability systems have also reviewed the 
processes used in the educational system, to determine 
if programs were being implemented with integrity 
and within the spirit of the policy that created them. 
Examples include the curriculum review cycle, or 
long-range facilities planning in a district. There are 
several types of process-oriented accountability 
systems, including accreditation reviews and school 
improvement reviews. Some of these reviews have 
traditionally been completed by state department of 
education staff in conjunction with district and school 
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officials. In some instances, independent accrediting 
bodies have worked with a state to conduct 
accreditation reviews. Overall, the traditional focus of 
accountability has been on the inputs to education, 
with the unit of analysis typically being the school 
building or district. 

Finally, states have held local education agencies 
accountable for the operation of specific programs, 
generally targeted at special populations of students. 
This type of accountability has focused on particular 
groups of students with special needs, such as migrant 
students, poor students, or students with disabilities. 
This form of accountability is designed to ensure that 
either state or federal categorical aide is being 
allocated to support the student populations for which 
it is intended. The unit of analysis is the specific 
program, and, similar to accountability for general 
education, accountability for special education has 
focused on inputs and processes of program delivery 
rather than student outcomes. Traditional program 
compliance seeks to answer such questions as 

• Are the teachers funded through this program 
teaching students eligible for the program? 

• Are the funds for the program being expended 
on materials for the program ? or 

• Has the program established the required 
parent advisory committee? 

Accountability Reform 

Today, general education accountability systems 
are changing in two ways: 

(1) The substance of accountability — the nature 
of what schools and districts are being held 
accountable for — is changing. Accountability 
systems are evolving toward a focus on student 
outcomes and program improvement that 
includes all student populations and programs 
within general education accountability. 

(2) How accountability efforts are implemented 
— the process of how accountability is conducted 



— is changing. Accountability systems are 
evolving from a process utilizing checklists of 
inputs to a qualitative review of district and 
school plans and student outcome data. 

Changes in the Substance of Accountability 

Accountability systems are expanding and 
evolving to place greater emphasis on student 
outcomes. States are adding indicators to their 
accountability systems that describe student outcomes 
and making these indicators public through district 
and school report cards. In 1988-89, New Mexico 
established a state report card that ranks districts by 
test scores, and requires districts to publish an 
accountability report by school in their local 
newspaper. Revisions to Pennsylvania’s education 
regulations in the early 1 990s required schools to 
develop profiles to document student outcomes and 
describe educational programs. 

Missouri provides one example of how a state 
has placed greater emphasis on student outcomes. In 
the past, the Missouri School Improvement Process 
used results from the Missouri Mastery Achievement 
Tests (MMAT) as one component of accountability. 
However, if a district was found deficient in student 
achievement (as reflected by its test scores) it could 
still be fully accredited if the other areas of evaluation 
— processes and input resources — were ranked 
high enough. Now, under standards-based reform, the 
highest possible accreditation status granted to a 
district with deficient student achievement is 
“provisionally accredited.” Maryland, Kentucky, 
Texas, Florida and Colorado are but a few other 
states that have reformed their accountability systems 
to place greater emphasis on student outcomes. 

It is important to note that while states have 
expanded their emphasis on student achievement, 
many states have maintained the process elements of 
their accountability systems. However, the process 
elements are evolving to focus more on program 
improvement. Indeed, states and independent 
accrediting organizations are encouraging districts 
and schools to use outcome data in developing plans 
for improving programs. States are implementing 
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processes that require districts to describe how they 
will help students meet standards established by the 
state. Some states have been adding elements of 
strategic planning to their accountability systems. In 
New Mexico, after developing focus areas jointly with 
the state, districts must submit a strategic plan, the 
Educational Plan for Student Success (EPSS), upon 
which the district is evaluated in subsequent 
accreditation cycles. In 1 993, amendments were made 
to Pennsylvania’s education regulations requiring 
each district to develop a six-year strategic plan to 
guide schools in helping students achieve learning 
outcomes identified in the state education regulations. 
Regardless of their accreditation rating, districts in 
Missouri are required to write a school improvement 
plan addressing issues cited in state accreditation 
reviews. 



In addition to emphasizing program improve- 
ment, some states are integrating their accountability 
systems so that different student populations are 
included in the same accreditation or accountability 
system. For example, California has historically 
integrated a number of programs for accountability 
purposes through its Coordinated Compliance Review 
(CCR) process. The CCR is primarily a coordinated 
compliance effort, that is, all categorically-funded 
programs arrange to have their compliance 
monitoring visits at the same time. The reviews 
include a visit to the school, parent interviews, 
classroom observations and document reviews. 

Each program has its own compliance items that 
must be evaluated by team members. Local 
respondents report that the team members each 



Regional Agencies Responsible for School Accreditation 

Like states, independent accreditation agencies are also reforming their processes to empha- 
size student outcomes and program improvement. Independent regional agencies responsible for 
accreditation of schools engage in a two-tiered system of data collection. The first tier is focused on 
basic inputs and resources available to a school, the second on student outcomes and school 
improvement processes. 

The first tier of data collection is based on traditional systems for accountability. This tier 
focuses on inputs, such as library holdings and number of faculty. Historically, these measures 
developed as mechanisms for quality control, were based on the assumption that inputs relate to 
quality, and were used to ensure that each school maintained a minimum level of resources 
necessary to perform basic school operations. 

The second tier focuses more directly on indicators of quality as measured through student 
outcomes and school improvement processes. Student outcome data are used by the school as a 
source of self analysis, and contributes to the development of a school improvement plan. Student 
outcomes and the school improvement process are reviewed by a set of peers, typically a cross 
section of education personnel, who report back to the regional agency. 

The two-tiered system is configured differently in each region. Until recently, some continued 
to place greater emphasis on inputs, while others began moving towards an emphasis on outcomes 
and improvement processes at earlier stages. Though input data are collected more frequently than 
outcome data in most regions, the general trend for all agencies is toward outcomes-based 
accountability. 



